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Abstract 

Consider briefly the equations of fluid dynamics — they describe the 
enormous wealth of detail in all the interacting physical elements of a 
fluid flow — whereas in applications we want to deal with a description 
of just that which is interesting. In a wide variety of situations, sim- 
ple approximate models are needed to perform practical simulations 
and make forecasts. I review the derivation, from a mathematical 
description of the detailed dynamics, of accurate, complete and use- 
ful low-dimensional models of the interesting dynamics in a system. 
The development of centre manifold theory and associated techniques 
puts this modelling process on a firm basis. As in Guckenheinmer & 
Holmes H, §2.5]: 

". . . these new methods will really be conventional pertur- 
bation style analyses interpreted geometrically. . . " 

But the geometric viewpoint of dynamical systems theory greatly en- 
riches our approach by providing a rationale for also deriving correct 
initial conditions, forcing and boundary conditions for the models — all 
essential elements of a model. 
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1 Introduction 

In secondary school we learn of the parabolic flight of a ball. In university 
physics we learn how it spins. In elasticity courses we learn that a ball 
deforms as it spins and bounces. In each successive stage of the modelling 
of the ball we deal with more details of the dynamics: first the position and 
velocity of the centre of mass, then position, orientation and their velocities, 
and lastly the position and velocity of every part of the ball. In this paper 
I review the reverse of this process: namely the reduction from equations 
describing the very detailed dynamics of a system down to simpler "model" 
equations dealing with the dynamics at a relatively coarse level of description. 

A model is "simple" if it deals with just a few characteristics of the 
physical problem. For example, in the flight of the ball we describe just the 
movement of the centre of mass rather than the movement of each part of 
the ball. Describing just a few characteristics and so written in terms of just 
a few parameters, a simple model is of low-dimension when compared with 
the actual physical system. A model is useful if it describes the dynamics 
of interest with very little extraneous details: we are usually interested in 
how the ball as a whole moves without needing to know anything about its 
deformation as it spins and bounces. It is the rationale, theory and practice 
of such reduction in dimensionality that I review. 

The general challenge is to start with an accurate and reliable description 
of the dynamics of a system of interest, a "Theory Of Everything" (toe) as 
I wryly call it in this article, then to analyse it systematically and extract 
routinely the simple, low-dimensional dynamical models which are relevant 
in given situations: 

toe — > model . 

To do this, we invoke centre manifold theory, introduced in §Q, and associated 
techniques based upon geometric pictures in the state space of the dynamical 
system. The use of centre manifold theory for this modelling was initiated 
by Coullet & Spiegel MM and Carr & Muncaster [ER p7[. The rationale of 



exponential collapse that underpins centre manifold theory has been also in- 
voked in other methods, but I argue that this approach has many advantages 
over the alternatives. 

Applications of the theory are widespread, some are discussed in §[3] and an 
historical perspective given by Coullet & Spiegel §1]. Specific examples 
of this process of modelling by dimensional reduction are: 
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• elasticity — > rigid body motion (mentioned above); 

• heat or mass transfer — > dispersion in a pipe or channel (§§ |3.2|) ; 

• Navier-Stokes equations — > thin films, sheets & jets of fluids (§§|3.3|); 

• Navier-Stokes & heat — > convection (§§|3~4l); 

• Markov chain — > quasi-stationary distribution ||131j| ; 

• elasticity — > beam theory of bending and torsion (§§ |5.1|) ; 



atmospheric models — > quasi-geostrophic approximation (§§ |5.2|) 



Although my interest, and thus this review, lies primarily in the field of fluid 
mechanics, the modelling issues addressed are relevant to any evolutionary 
system. However, there is not yet enough theory to support all the inter- 
esting applications of the concepts and techniques that we encounter. The 
main limitation on rigour is that in many of these applications the "low- 
dimensional" model is still actually of "infinite dimension" , for which 
there is almost no theory that is both rigorous and useful — more specific 
comments are sprinkled throughout. 

There are many advantages in the centre manifold approach when com- 
pared with other methods of analysing dynamical systems to develop low- 
dimensional dynamical models. 

Competing small effects need not appear at leading order in the analysis, 
§f|; consequently you obtain the flexibility to justifiably adapt the model to 
different applications without redoing the whole analysis. Just one example 
of this flexibility is used to modify the governing equations of thin fluid 



films, §§ |3.3| , so that the model incorporates the extra dynamical degree of 
freedom to resolve wave dynamics on the film. To recover a description of 
the physical problem, we sum to high-order in the modification while only 
considering adequate low-order physical terms. Such flexibility also justifies 
a local description of the interaction between counter-propagating waves. 

The geometric picture of evolution near the centre manifold suggests anal- 
ysis, §§ |6.1| , that provides correct initial conditions to use with the model to 
make correct long-term forecasts. The algebra is based upon how neighbour- 
ing trajectories evolve, identifying which ones approach each other exponen- 
tially quickly and thus have the same long-term evolution. For example, in 
the long-term dispersion down a channel (§§ |3.2| ) we can discern the difference 
between dumping contaminant into the slow moving flow near the bank and 
into the fast core flow. Normal form transformations, 55ti.2L also illustrate 



the projection of initial conditions onto the centre manifold. In addition, 
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normal form transformations show limitations in the so-called slow manifold 
models, §|5|, that are formed by removing the dynamics of fast oscillations 
(as in beam theory or rigid-body dynamics). Through nonlinear interaction, 
neglected fast waves may resonate and cause inevitable errors to accumulate 
over time. In contrast, centre manifold models guarantee the existence of 
forecasts that are accurate exponentially quick. 

One attribute of basic centre manifold theory is that it deals with au- 
tonomous dynamical systems. However, in the presence of a time-dependent 
forcing, §§ |7.1| , the system is pushed away from the centre manifold and so we 
use the geometric projection of initial conditions to determine what forcing 
is appropriate in the model. I show, for example, that a model may be very 
sensitive to a forcing which more primitive approaches would neglect. There 
is also many interesting issues in the modelling of noisy dynamical systems, 
as expressed by stochastic differential equations. I argue, §§|T7^, that centre 
manifold concepts provide relatively straightforward tools to approach this 
problem rationally. These methods should apply to interesting questions 
such as: what influence may turbulence have on dispersion? and how does 
substrate roughness affect the flow of thin films? 

Many useful models are expressed in terms of partial differential equations 
in space and time. Such partial differential equations must have boundary 
conditions. For example, models for dispersion in a channel or for beam 
theory require boundary conditions at the inlet and outlet of the channel 
or the ends of the beam respectively. Arguments based upon the spatial 
evolution away from the boundary, applied to both the full system and the 
model, give a rationale which provides correct boundary conditions, §[§[ To 
leading order these boundary conditions are typically those obtained from 
physical heuristics. However, there are corrections accounting for more subtle 
features of the dynamics. 

Computing details of the centre manifold and its dynamic model often 
involves considerable algebra. This is especially true for centre manifolds of 
more than just a few dimensions as the algebraic complexity of the model 
may increase combinatorially. Computer algebra can be used to minimise 
the human labour involved. After all: 

"It is unworthy of excellent persons to lose hours like slaves in 
the labour of calculation" . . . Gottfried Wilhelm von Leibniz. 

The challenge addressed in §|9| is to develop algorithms for computer based 
algebra packages which are simple and reliable to implement. 

All the above aspects are features of a complete approach to modelling 
dynamical systems based upon centre manifold theory, techniques and con- 
cepts. 
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Throughout this review we focus on continuous time dynamics, flows, as 
expressed through differential equations. Similar concepts and analysis can 
be also developed for discrete maps but I will not elaborate on these. 

2 Rational modelling theory 

Simple models must have low dimension corresponding to the few variables in 
the model. Since a model must have something to say about the toe — states 
of the model correspond to states of the toe — the state space of the model 
must be able to be embedded in the high-dimensional state space of the toe. 
Typically we imagine that the state space of a model forms a low- dimensional 
differentiable manifold within the state space of the toe. 

If the model is to accurately capture the dynamics of the toe, then the 
manifold must be made of some of the trajectories of the toe. The detail 
lost in apparently ignoring all the dynamics outside the states described by 
the model is an inevitable consequence of forming a simple, low-dimensional 
model. The process of analysing the toe and creating a low-dimensional 



model is sometimes termed coarse graining [ 117 , e.g.] because of the loss of 
fine detail in forming a model. In this section I introduce centre manifold 
theory as a basis for the rational modelling of dynamical systems, as first 



recognised by Coullet & Spiegel [44] and Carr & Muncaster [28. 27 . 



2.1 Exponential collapse gives a rationale 

If many modes of the toe decay exponentially, then all that is left after 
the transients decay are the relatively slowly evolving modes of long-term 
importance. The evolution of these few significant modes effectively forms a 
low-dimensional dynamical system on a low- dimensional set of states in state 
space. Through the rapid exponential decay all neighbouring trajectories are 
quickly attracted to these low- dimensional dynamics and so they form an 
accurate low- dimensional model of the toe. 

This idea also lies behind the construction of so-called inertial manifolds 



by Temam [|1 71|[ and others. Functional analysis is used to construct inertial 



manifolds and estimate some properties such as their dimension (see Foias 



et al |)7|) E3 f° r example). But what if we are not just interested in the 
ultimate attractor, but are curious about long-lasting transients? After all, 
the eventual fate of the universe is either the big crunch or a featureless death 
by high entropy — but before these become an overriding issue to humans 
there are many problems of interest to study, albeit transient. A more prosaic 
example is the dispersion of material in an infinitely long channel or pipe: the 
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ultimate attractor is a completely dispersed contaminant of effectively zero 
concentration everywhere; however, as seen in §§ |3.2| , we are very interested 
in modelling the long transient of how a contaminant spreads as it is carried 
downstream. 

One case where the distinction between exponential decay and long- 
lasting importance can be made with absolutely clarity is in the neighbour- 
hood of an equilibrium or fixed point. Without loss of generality we take the 
reference equilibrium at the origin. Let the linearised dynamics be it = Cu, 
then the eigenvalues of the linear operator £ determine the dynamics in the 
neighbourhood: 

• modes with 9?(A) < decay exponentially; 

• modes with 3?(A) = do not decay, are long-lasting and form the basis 
of a low- dimensional model. 

An elementary example from [|137|1 is 

x = — xy , and y = — y + x 2 — 2y 2 . (1) 

Very quickly all trajectories approach a curved "subspace" in state space, 
called the centre manifold, y = x 2 in this example as shown in Figure |I[ Thus 
no matter what the initial condition, the only states of long-term interest are 
those of the centre manifold. The evolution on the centre manifold, here 
x = —x 3 , then forms a low- dimensional model of all the dynamics in the 
system. 

In the above, I introduced the criterion that 9?(A) = for determining the 
modes that form the low-dimensional model. Arguments have been devised 
to relax this restrictive equality. An argument could be made that modes 
with 9R(A) < —7 < decay exponentially, whereas modes with 3?(A) > —7 
are at least fonder-lasting and form the basis of a low-dimensional model — 
here it is the modes with 3?(A) < —7 that "collapse" the state space. For an 
elementary example, also from |137|, consider 



x = ex — xy , and y = —y + x 2 — 2y 2 , (2) 
which has the exponentially attractive manifold 



x 2 



y = TT2i' (3) 

as seen in Figure ^, on which the model evolution is x = ex — x 3 / (1 + 2e) . For 
e > this is termed a centre-unstable manifold, a concept used by Armbruster 
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Figure 1: trajectories of the dynamical system (P plotted every At = 0.2 to 
show the rapid approach, roughly in 2 units of time, to the centre manifold, 
A4 C . Observe how all these initial conditions collapse onto a one-dimensional 
set of states in which all the long-term dynamics take place. 
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Figure 2: trajectories of the dynamical system (Q) with parameter e = 0.2 
plotted every At = 0.2 to show the rapid approach, roughly in 2 units of 
time, to the centre-unstable manifold, M. cu . Again observe the collapse onto 
a one- dimensional set of states. 



AJ Roberts, February 5, 2008 



2: Rational modelling theory 



10 



et al P| to investigate the Kuramoto-Sivashinksy dynamics, by Cheng & 



Chang |36| for subharmonic instabilities of waves, and by Chow & Lu |4(J 
to compare with the method of averaging. For general e, not too large in 

jl.lC] 



180 



which when 
4 



141 



178 . Invariant manifolds, 



magnitude, (^D describes an invariant manifold 
exponentially attractive may be used to create accurate models 
such as that of dispersion in simple channels 
based upon modes with dt(X) > —7, may improve the numerical solution of 
spatio-temporal PDEs through what others have called the nonlinear Galerkin 
method ||105| , |170| , |64] , |104| , |65| . The disadvantage of these more general 
invariant manifolds for modelling is that the consequent algebraic analysis in 
constructing the manifold is significantly more difficult. In §§^]3| I discuss a 
method to approximate these more general invariant manifold models while 
maintaining the relatively simple algebra associated with centre manifolds. 

A quite different concept in modelling dynamics is what van Kampen 
175 1 calls that of the guiding centre. In the presence of fast oscillations, 



such as short-period waves, we may be only interested in the long-term evo- 
lution of the dynamics of the mean. For example, incompressible fluid dy- 
namics ignores fast sound waves (for example, see the quasi-incompressible 
approximation of Durran p7[ ). In such a case the particular dynamical flow 
without oscillations acts as a centre for flow with rapid oscillations and so is 
considered to form a low- dimensional model. In many applications, such as 
beam theory | 145 | or atmospheric flows 1 102 , e.g.], the model dynamics are 



known as the slow dynamics on the slow manifold. However, the modelling 
issues associated with this concept are much more delicate and I discuss them 
in more detail in 



For the moment let us concentrate upon exponential 
collapse to the centre manifold as a rationale for forming low- dimensional 
dynamical models. 

A completely different approach, albeit justified by the same exponential 
collapse, is to use symmetry considerations to sketch out possible structurally 
stable, low-dimensional models. See for example, or the review by Craw- 
ford & Knobloch 



50 



on symmetry in fluid dynamics. The limitation of this 
approach is that one can practically never determine quantitative coefficients 
in the model. Hence such an approach may be satisfactory for predicting the 
broad range of phenomena possible, but it cannot produce a model able to 
make detailed forecasts about a specific physical situation. 



2.2 Centre manifolds 

The centre manifold, J\A C , is the curved "subspace" to which all trajectories 
in the neighbourhood of a fixed point are attracted exponentially quickly. 
Being composed of trajectories of the toe and being low-dimensional, the 
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evolution on A4 C qualifies as forming a model of the toe. 
Three theorems claim: 

1. M. c exists for the previously mentioned structure of eigenvalues, pro- 
vided the nonlinear terms are not "badly" behaved; 

2. M. c is relevant as all solutions in the neighbourhood are attracted ex- 
ponentially to a solution on M. c ; 

3. M. c may be constructed to any desired degree of accuracy (asymptoti- 
cally speaking). 

Detailed proofs of these theorems have, for example, been given in the ex- 
cellent little book by Carr [26], and more recently by Vanderbauwhede and 
Iooss | |1 77| , |176| |. In this subsection I address their role in low-dimensional 
modelling. 



2.2.1 Existence 

Most statements of theory address dynamical systems in the separated form: 

x = Ax + f{x,y), (4) 
V = By + g(x,y), (5) 

where the eigenvalues of the matrix A have real-part zero, the eigenvalues of 
the matrix B have strictly negative real-part, and / and g are quadratically 
nonlinear functions at the origin, of O (x 2 + y 2 ) where x — \x\ and y = \y\. 
However, we address dynamical systems, the toe, in the general form 

u = Cu + f(u), (6) 

where u(t) e M n , the linear operator £ has m eigenvalues with zero real- 
part (counted according to their multiplicity), the remaining eigenvalues are 
strictly negative and bounded above by —7 < 0, and / is a quadratically 
nonlinear at the origin, of O {u 2 ). A linear transformation of variables will in 
theory transform the dynamical system from one form to the other. However, 
in practise we prefer to perform analysis with meaningful physical variables 
and so the general form (^]) is more appropriate in applications. 

Linearly, according to u = Cu, all the dynamics will collapse exponen- 
tially quickly onto the centre subspace, 

£ c = span{ei, . . . ,e m } , 

where ej are the m eigenvectors (or generalised eigenvectors) of the m eigen- 
values with zero real-part (counted according to multiplicity). Theory asserts 
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(a) linear 



0.3 




x 



Figure 3: shows an example of the exponential collapse of (a) linear dynamics 
onto the centre subspace S c , each dot on a trajectory a fixed time At apart, to 
compare with (b) showing that the nonlinear dynamics "bend" the subspace 
to the centre manifold M. c and produce a slow evolution thereon. 
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that at least near the origin the nonlinear terms just "bend" this invariant 
subspace and modify the dynamics on the subspace, as shown in Figure 

Theorem 1 (existence) sufficiently near the origin, in some neighbour- 
hood U , there exists an m- dimensional invariant manifold for (|6[), A4 C , with 
tangent space S c at the origin, in the form u = v(s) (that is, locations on A4 C 
are parameterised by a set of variables s, often called the order parameters,). 
The flow on Ai c is governed by the m- dimensional dynamical system 

s = gs + g(s), (7) 

where Q is the restriction of £ to S c , and the nonlinear function g is deter- 
mined from M. c and ^). Because of the nature of the eigenvalues of £ this 
invariant manifold is called a centre manifold of the system. 

A centre manifold is, in some neighbourhood of the origin, at least as 
differentiable as the nonlinear terms /. However, it may not be analytic 
even though / is analytic. Also, a centre manifold need not be unique, but 
the differences between the possible centre manifolds are of the same order 
as the differences we set out to ignore in establishing the low-dimensional 
model [|137| , |140|| . Non-uniqueness, when it arises, is irrelevant for modelling. 

In application, such as the fluid dynamics problems discussed in §|3|, we 
need theory dealing with not only infinite dimensional toe's, but also infinite 
dimensional centre manifolds. Extensions of the above theorem to infinite 
dimensional dynamics are extant but limited. The most general theory I 



am aware of is currently due to Gallay [71], but it suffers from restrictions 
upon the nonlinear terms, they have to be bounded, which limits its rigorous 
application. Scarpellini ||151|| apparently places significantly less restrictions 



upon the nonlinearities in the dynamical equations, but while he addresses 
infinite dimensional centre manifolds, the results are severely constrained by 
requiring finite dimensional stable dynamics. Haragus |85, 86] has developed 



theory supporting infinite dimensional models, such as the Korteweg-de Vries 
equation, but only by placing extremely limiting restrictions upon the time 
derivatives in the toe. 



2.2.2 Relevance 

Based on the rationale of neglecting rapidly decaying transients, our intention 
is to consider (|7|) as a simple model system for the toe @; simpler in 
the sense that it has lower dimensionality, m instead of n. However, there 
is a subtle point which is often overlooked. We must be assured that the 
actual solutions of the model ([?]) do indeed correspond to solutions of the 
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full system (|6|). Exponential attraction to an invariant manifold is not enough 
to assure us that the solutions on the manifold actually model accurately all 
the nearby dynamics.^] 

Theorem 2 (relevance) The neighbourhood U may be chosen so that all 
solutions of ^) staying in U tend exponentially to some solution of (Qj. 
That is, for all solutions u(t) G U for allt > there exists a solution s(t) of 
the model (|?|) such that 

u(t) = v («(*)) + O (e" 7 '*) as t ->• oo , 

where —7' may be estimated as —7, the upper bound on the negative eigen- 
values of the linear operator C. 

This theorem is crucial to modelling; it asserts that for a wide variety 
of initial conditions the dynamics of the toe decays exponentially quickly 
to a solution which can be predicted by the low- dimensional model. Some- 
what pessimistically, the theorem requires initial conditions to be sufficiently 
small, namely in U. But consider the system shown in Figure [I]. Observe 
that all trajectories within the picture asymptote exponentially to the centre 
manifold. Thus the conclusions of this theorem are correct for at least all 
initial conditions within the figure. In practice the neighbourhood U may be 
quite large. 

2.2.3 Approximation 

We need to find an equation to solve which gives the centre manifold Ai c . 
This is obtained straightforwardly by substituting the assumed functional 
relations, that u{t) = v(s(t)) where s = Qs + g(s), into the toe and 
using the chain rule for time derivatives to obtain 

Cv(a) + f{v(a)) = j£[ga + g{8)] . (8) 

This is the equation to be solved for the centre manifold M. c . 

An extra condition is that S c is the tangent space of M. c at the origin. 
Put more crudely, this requires that v is quadratically close to £ c . This 
condition ensures that the constructed manifold truly contains the whole of 

^or example, consider the system x = x + xy and y — —y which has the exponentially 
attractive unstable manifold y = 0. There is generally an unavoidable 0(1) discrepancy 
between the full system, with solutions x(t) ~ Ae l + B, and the low-dimensional model, 
x = x with x(t) ~ Ae*, despite the exponential collapse onto the unstable manifold. 
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the critical centre modes, and nothing but the centre modes. Without it, 
the solution of (^) could be based on an almost arbitrary mixture of linear 
modes. Indeed, other invariant manifolds of note satisfy but are tangent 
to different subspaces as s — > 0. 

It is typically impossible to find exact solutions to @. However, in 
applications we may approximate Ai c to any desired accuracy. For func- 
tions 4> : M m — > M n (imagine that <f> approximates the shape v) and 
if) : M m — > M m (imagine that if) approximates the evolution s = Qs + g(s)) 
define the residual of (f|) 

R(cf>, if)) = ^-iP(s) - C<f>(s) - f (<f,(a)) , (9) 

OS 

and observe that M. c satisfies R(v(a), Qs + g(s)) = 0. 

Theorem 3 (approximation) If the tangent space of <p(s) at the origin 
is S c , and the residual R(<j),ip) = O (s p ) as s — > for some p > 1 (where 
s = \s\) then v(s) = (f>(s) + O (s p ) and s = Qs + g(s) = if)(s) + O (s p ) as 
s -> 0. 

That is, if we can satisfy (§) to some order of accuracy then the centre 
manifold is given to the same order of accuracy. 

In problems specified in the separated form (|4]-|5|) the centre manifold may 
be determined simply by iteration [^B], e.g.]. However, typically a solution is 
sought in the form of an asymptotic power series in s as developed by Coullet 
& Spiegel 0| for the general form (|) (and reinvented by Leen J98|). Such 



a power series solution looks very like the Lyapunov-Schmidt method |83| . 
e.g.] for determining the nontrivial fixed points near a simple bifurcation; 
in contrast though, centre manifold theory also determines the dynamics, 



see H p.67| , |119| , |39[] for comparisons. Recently, I developed [|148|| an iterative 



algorithm, for the general form, with the virtue that it is readily implemented 
in computer algebra, see 

Centre manifold models need not be anchored to just the one equilibrium. 
Some very interesting models are constructed for the dynamics in the neigh- 
bourhood of a manifold of equilibria. Such models may be uniformly valid 
across the whole set of equilibria. One example is given in § §3.3| where a fluid 
at rest of constant but arbitrary thickness provides the reference equilibria 
for a model of the evolution of the fluid film's thickness. 

2.3 A vital extension 

Requiring that 3?(A) = precisely as the criterion for the modes of the 
dynamical model is far too restrictive in practice. A trick rescues the theory 
from obscurity. 



AJ Roberts, February 5, 2008 



§2: Rational modelling theory 16 

It is easiest to see the trick in an example: to (0) adjoin the trivial 
dynamical equation e = 0. Based on the linearisation about the equilibrium 
at the origin in the exy-spa.ce (note that in this space ex is a nonlinear term) , 
there then exists a two-dimensional centre manifold, parameterised by e and 
x. The relevance and approximation theorems may similarly be applied to 
construct the centre manifold for small x and e, and to validate the model, 
that 

e = , and x = ex — x 3 + O (s 4 ) , 

where s = \(e,x)\. Fixing upon any small value for e then gives a model 
involving only the evolution of x, from which one may predict, for example, 
the presence of a pitchfork bifurcation. 

This example shows that we may apply centre manifold theory to prob- 
lems which do not precisely fit the linear structure required by the theory. By 
adjoining trivial dynamical equations we may, in essence, perturb eigenval- 
ues with small real-part, either negative or positive, so that the "interesting" 
modes then have eigenvalues that precisely satisfy 9ft(A) = and hence are 
included in the centre manifold. This trick can be not only used to unfold 
bifurcations, as above, it may also be used to partially justify the long-wave 
approximation (§§ |3.2| ), and to approximate "hard" problems by writing them 
as perturbations of easier problems (§§ |3.3|) . 



Because parameters are so important in application, it is useful to quote 
a more powerful and flexible approximation theorem. Consider the extended 
dynamical system with £ parameters e: 

e = 0, and ii = Cu + f(e,u), (10) 

with C as before. For functions <p : IR e x JR m — > IR n approximating the centre 
manifold, and ift : lR e x lR m — > lR m approximating the evolution thereon, 
one may argue that 

Theorem 4 (parameter approximation) // the tangent space of 4>(e, s) 
at the origin is lR e x £ c , and the residual of (|7ZJ) is R(</>, ifr) = O (s p + e q ) as 
(e, s) — >• for some p > 1 and q > 1, then v(e, s) = <p(e, s) + O (s p + e q ) 
and s — Qs + g(e, s) = ift(e, s) + O (s p + e q ) as (e, s) — > 0. Arguments also 
justify the same statement but with errors O (s p , e q ). 

Consequences of this property are followed up in §|] where I discuss the 
flexibility of centre manifold models. 
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3 Physical applications show the potential 

Centre manifold analysis has often been applied to reduce dynamics down to 
a "handful" of odes, typically the centre manifold is of dimension 1-3. Also 
typically, a normal form transformation is then used to classify the dynamics 
obtained on the centre manifold. This established approach is described in 
various books dealing with dynamical systems, see Carr [p^] , Guckenheimer 
& Holmes ^ Ch.3], Wiggins |8(| Ch.2], Iooss & Adelmeyer @, Ch.l], or 
Kuznetsov |96|, Ch.3— 5]. However, there is much greater scope for the use 
of centre manifold analysis in low- dimensional modelling. After a brief dash 
through some standard applications of the theory, in the rest of this review 
I outline some of the interesting applications that extend beyond current 
rigorous theory. 



3.1 A dash of straightforward applications 

• Fluid mechanics is a haven of nonlinear dynamics and the application 
of centre manifold theory. The theory has been used in analysing the 
dynamics of Taylor vortices in Taylor-Couette flow [97, [88|, and 
the non-axisymmetric dynamics [EM EM involving mode competition. 



Mode interactions in rotating convection ||1 16|| are analysed with centre 
manifolds, the dynamics of convection in porous media by Neel 

11231 , PH, and others Jf|. Arneodo et al §, g, |, g reduced the 



dynamics of triple convection down to a set of three coupled odes, 
numerically verified the modelling and then proved the existence of 
chaos. 



1_R [SR e.g.] have used centre manifold 



A number of studies 
theory to help analyse the effectiveness of feedback control in nonlin- 
ear dynamics [P2"| , sometimes the centre manifold is called the slow 
manifold [|93|, l 



161], see §g. These control problems are often con- 



cerned with systems where the control is delayed, leading to formally 
infinite-dimensional dynamics, and they investigate the effect of the de- 
lay on the dynamics through a low-dimensional centre manifold model 
fl5|, pjl, p5|, e.g.]. Some studies examine the centre manifolds of de- 



lay differential equations in their own right, for example: existence in 
PDEs |100|| , and the effects of multiple delays [14j]. Usually, in these 
applications any finite time delay is washed out by the slow-evolution 
paradigm on the centre manifold. However, in some other applications 
(see §§ |3.2|) it is attractive to transform a centre manifold model into 
an equivalent model which possesses delays or "memory." 
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Other mechanical systems of interest involve nonlinear elastic |77 



and viscoelastic ||165| , |164|| springs. The usual aim is to determine the 
onset and form of nonlinear oscillations, such as airfoil flutter |77j or 
chaos in pipes conveying fluid [99H, near some reference equilibrium. 



The field of economics is increasingly using the concepts and techniques 
of nonlinear dynamics, as described by Chiarella |37] , and centre man- 
ifold theory has a role to play e.g.]. 

A remarkable application occurs in determining steady solutions in 
large physical domains. As developed by Mielke to explore Saint- 
Venant's principle in elasticity [ |113] p. 11] , the spatial dimension 

is treated as a "time" variable and centre manifold theory applied. 
The analysis elucidates spatial structures in the problem, such as the 
Ginzburg-Landau equation for nearly periodic solutions. Applications 
of this idea have been to: internal waves of a stratified fluid in a two- 
dimensional channel and capillary surface waves ||114]| ; Poiseuille flow 
between parallel plates 0; hydrodynamic stability in an infinitely long 
cylinder by Iooss et al pi [89|] ; the dynamics of Taylor-Couette flow also 



by Iooss & Adelmeyer |88 ]; and bifurcations and other behaviour near 
spatially periodic structures rather than spatially constant |H, |115 . 
This trick is also employed, see §|| to determine boundary conditions 
for models of spatio-temporal dynamics. 



In the last of the above mentioned applications there is no time depen- 
dence, no dynamics! This is a disappointing limitation. However, by stretch- 
ing the centre manifold techniques and concepts past the rigorous extent of 
current theory, we may form models of spatio-temporal dynamics. In prob- 
lems with large-spatial extent, as discussed in the next three subsections, the 
resulting centre manifold will be of "infinite dimension". Nonetheless, the 
model will be significantly simpler in one or more characteristics than the 
"infinite dimensional" toe from which it is derived — such models are useful. 



3.2 Slow space variations — dispersion in a channel 

In a long, thin channel or pipe, as shown schematically in Figure ^, the 
dominant process of dispersion of a contaminant is diffusion across the thin 
channel. This leads to decay of all modes except the constant mode (across 
the channel). But at different stations the constant will typically be dif- 
ferent, and so the cross-sectional mean concentration C will depend upon 
downstream distance x. The shearing then causes these variations in x to 
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x 



advection 

u(y) 



cross-stream 
diffusion 



concentration 

c(x,y,t) 



Figure 4: schematic diagram of the dispersion of a contaminant with con- 
centration field c(x,y,t) in a channel with advection u(y) and cross-stream 
diffusion. 



move and interact leading to the Taylor model [|168| , |169 



— --U— + D—+ (11) 

dt dx dx 2 

where U is simply the mean downstream velocity, but the effective diffusivity 
D is a nontrivial function of the velocity field. The Taylor model predicts 
the long-term concentration is in the shape of a moving and spreading Gaus- 
sian. This model is derived rigorously via centre manifold theory using an 
interesting trick introduced in ||138| . 



The simplest example is the physical problem shown in Figure |] which 
has the non-dimensional governing equation 

dc _ u ty\® c _j_ _j_ ^ c (12) 
dt dx dx 2 dy 2 ' 

where, for definiteness, the advecting velocity may be u(y) = 3(1 — y 2 )/2 in 
a channel —l<y<l, and where 5, the inverse square of a Peclet number, 
is typically very small. Now take the Fourier transform of (|T2|), so that 
c = /f^ ce lkx dx, to obtain the Fourier space equation 

dc d 2 c 

- = - i ku(y)c-Sk 2 c+ — . (13) 



Then utilise the trick introduced in § |273| to unfold bifurcations, but here to 
introduce the approximation of a large-scale, slowly-varying spatial depen- 
dence. The trick is to adjoin to ( |T3| ) the trivial equation that the wavenumber 
k is constant: 

Adjoining this trivial equation focuses the centre manifold analysis upon the 
small wavenumber, large-scale dynamics in the channel. The advection term 
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—iku(y)c is then "nonlinear" in k and c. Linearly (in this new sense) cross- 
channel diffusion causes concentrations c to decay exponentially quickly to a 
constant with respect to y: c ~ C. Centre manifold theory applied to (|13|- 
14[) then derives, as a matter of course, that the Fourier transform of the 



cross-channel average, C, will in the long-term evolve according to 

d l = - k6 -{ i + ^E) k26 + ( k3 )' (15) 



Taking the inverse Fourier transform leads to the Taylor model (|lT[) , with 
here the particular coefficients U = 1 and D = 5 + 2/105. 



Observe that the Taylor model (11), while certainly simpler than the 



toe (0), is still of "infinite" dimension — there is an infinite freedom in 
C(x) that is governed by the model. In such "infinite" dimensional centre 
manifolds there is a much richer field of possible and applicable models to 
investigate than in centre manifolds of just a few dimensions. 

It is straightforward for the centre manifold analysis to compute higher 
order models of the dispersion, involving terms such as C xxx and C xxxx for 
example, that show the evolution of the skewness and kurtosis of the concen- 
tration distribution. Indeed, Mercer & I have extended the analysis of the 
dispersion in a channel ||109|| and pipe |110|| to very high order and shown, 



using a generalisation of the Domb-Sykes plot [ |109| , Appendix], that these 
models actually converge for non-dimensional downstream wavenumber \k\ 
less than roughly 10, depending upon the particular problem in hand (similar 
bounds also have been computed for beam theory, see §|5| and ||145|| ). Thus 



here we are assured that the model for dispersion resolves spatial details down 
to roughly 27r/10 times the downstream advection distance in a cross-stream 
diffusion time. This quantitative limit on the resolution is some 10 times 
better than that estimated by Taylor. The Relevance Theorem also assures 
us that the model will resolve temporal dynamics longer than a cross-stream 
diffusion time, the time-scale of approach to the centre manifold. Both of 
these limits to the resolution of the model can only be improved by retaining 
more dynamic modes in the model, as was done by Watt & I | |178| | in in- 
vestigating an invariant manifold model based upon the two or three gravest 
modes in the channel. That we can sometimes find these quantitative bounds 
to the domain of the validity of a low- dimensional model is part of the power 
of centre manifold theory. 

The above analysis in Fourier space is more-or-less rigorous. However, 
upon inspecting the details of the algebra it is apparent that the wavenumber, 
in the combination ik, just acts as a place holder for the spatial derivative 
d/dx. The adjoining of the trivial dynamical equation (p!4[), that dk/dt = 0, 
just focusses attention upon small wavenumber. Precisely the same effect is 
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achieved in physical variables simply by treating d x = d/dx as "small." A 
rationale for doing this is outlined in [ |138|| based upon the local dynamics 
in any reach of the domain, but rigorous it is not because the operator d x is 
unbounded and the extant theory |71[] cannot be applied directly. However, 



an analysis based upon this idea has the advantage that one deals in physical 
variables, rather than Fourier transformed quantities, and it easily generalises 
to more difficult problems as seen in the next two subsections. For example, 
one may analyse [ |109| , |110|| the effect upon the Taylor model of spatial and 
temporal variations in the flow-rate, width of the channel, and cross-stream 
diffusion. Interestingly, as first pointed out by Smith [|162||, the results may 



be recast in terms of a memory of the conditions upstream or at earlier times. 

The centre manifold analysis of dispersion in a pipe has also been ex- 
tended by Balakotaiah & Chang |10| to the dynamics in a chromatograph 
chemical reactor where chemical reactions occur either in the flow or with 
the walls of the pipe. 

3.3 Cross-sectional averaging is unsound — thin film flows 

The dynamics of thin films of fluid are important in many industrial, envi- 
ronmental and biological processes. An approximation of such a thin viscous 
fluid flow, as shown schematically in Figure |5|, with slow spatial variations 
leads to a Kuramoto-Sivashinsky type of equation. If surface tension a is the 
only driving force then the simplest long-wave model is 



dr] 
dt 




(16) 



where /i is the fluid viscosity and i](x,t) is the film thickness above a flat 
substrate. 

To analyse the Navier-Stokes equations, the toe, to derive such a model 



149|| , recognise that across the thin fluid film, viscosity acts quickly to damp 
almost all cross-film structure. The distinction between the longitudinal and 
cross fluid dynamics is exactly analogous to that of dispersion in a pipe; we 
proceed with a similar analysis. However, the equations are very different 
(see Figure ||). In particular, this problem has many nonlinearities: not only 
is the advection in the Navier-Stokes equation described by a nonlinear term, 
but also the thickness of the fluid film is to be found as part of the solution 
and its unknown location is another source of nonlinearity. Here, the only 
practical course of analysis is to deal with physical variables and treat d x as a 
"small" parameter which is negligible to the leading "linear" approximation 



(though recall that Haragus |86| otherwise justifies the Korteweg-de Vries 



equation for the inviscid, long- wave hydrodynamics). 



AJ Roberts, February 5, 2008 



}3: Physical applications show the potential 



22 



atmospheric pressure 



y = v{x,t) 



Navier-Stokes equation 

u(x,y,t) p(x,y,t) 



x 



solid, u = v = 



Figure 5: schematic diagram of a thin fluid film flowing down a solid bed. 



Assuming no longitudinal variations at all, a linear analysis of the equa- 
tions shows that there is one critical mode in the cross-fluid dynamics, all 
others decay exponentially due to viscosity. This critical mode is associated 
with conservation of the fluid and consequently it is natural to express the 
low-dimensional model in terms of the film thickness rj(x,t). An interesting 
aspect is the fact that although this is a nonlinear problem, conservation of 
fluid applies no matter how thick the fluid layer, and the state of no flow is 
an equilibrium for all constant rj. Thus the analysis is valid for arbitrarily 
large variations in the thickness of the film, just so long as the variations are 
sufficiently slow in space and time. A relatively simple toy example of this 
is also discussed in 



138 



These are examples, as mentioned in §§§ |2.2.3| , of 
a centre manifold analysis based upon a manifold of equilibria rather than 
being anchored to just one fixed point. 

Treating d x as a small perturbing operator, the centre manifold formalism 
follows to straightforwardly derive models such as flip]). Of course, higher 
order models may be straightforwardly constructed if necessary [148 , viz 



dq 
dt 



ad_ 

\i dx 



Is 3 5 

f] Vxxx _ f} Vxxxxx 
6 5 

11 



+ 3?7 r] x rj x 



+V*VxxVxxx + —rfrfxVxxx - V 3 VxVlx 



+ O (dl) . 



However, much more interesting is to model the 2D spread of a 3D fluid over 
a curved substrate [135]. Provided that, as in dispersion in a varying width 



pipe or channel ||109| , |1 10|| , the length-scale of curvature variations is large 
compared to the film thickness, a similar analysis leads to the model 



dt 



3/i 



-V- 



K) ■ Vk 



(17) 
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where: ( = r] — \nrf + ^kik 2 i] 3 is proportional to the amount of fluid locally 
"above" the substrate; k is the approximate mean curvature of the free- 
surface; K is the curvature tensor of the substrate; k±, k 2 , and k = k\ + k 2 
are the principal curvatures and the mean curvature of the substrate, respec- 
tively; and the V-operator is expressed in a coordinate system of the curving 
substrate. The effects of gravity and fluid inertia also may be included sys- 
tematically [|149|, §4] to produce a more extensive model. 



One significant limitation in the use of the whole family of models dis- 
cussed above is that they only resolve dynamics significantly slower than 
the time-scale of viscous decay, T « QArf /v, of the gravest shear mode, 
u\ oc sin(|/7r / 2rj) . For thicker fluid films, interesting dynamics occurs on 
about this time-scale. Another class of models is needed in such a situation. 
Traditionally these are obtained by integrating or averaging the horizontal 
momentum equation over the depth of the fluid to obtain an evolution equa- 
tion for the mean horizontal velocity u(x, t) ||133| , |30| , e.g.]. 



Unfortunately, such simple modelling methods do not just get the coeffi- 
cients wrong, they can fail dramatically. Abstractly, cross-sectional averaging 
is a projection of the dynamical equations onto some linear subspace of the 
state space, namely the space of functions which are constant over cross- 
sections. Typically, linear considerations suggest that this would be a useful 
procedure. But consider the simple example |96|, p!53] 



x = xy + x 3 , and y = —y — 2x 2 

whose trajectories are plotted in Figure || Linearly, x = and y = —y 
and so solutions exponentially quickly approach the subspace y — 0. Thus, 
projecting the dynamics onto y = to give x = x 3 may be expected to give 
a reasonable model of the long-term dynamics of the system from which one 
would deduce that x = is an unstable fixed point. But this is not so. The 
centre manifold is y = —Ix 1 — 4x 4 + O (x 6 ) whence we deduce the correct 
model of the long-term dynamics to be x = — x 3 + (x 4 ) and hence the origin 
is actually stable, as seen in Figure [| Cross-sectionally averaging dynamical 
equations is unsound as a modelling paradigm. 

Returning to the dynamics of a fluid film, observe that in the horizontal 
shear modes, u n oc sin(ri|/7r/2?7) there is a relatively large spectral gap between 
the gravest mode u\ and the next mode u 2 ] the eigenvalues are Ai = — 2.5u/r] 2 
and A2 = — 22.2z//?7 2 respectively. Surely we should be able to gather the u± 
mode into the centre manifold. 

The trick of §§|2.3| allows us to apply centre manifold techniques to obtain 



a coupled model for the evolution of u and r\ which resolves transients on a 
shorter time-scale. Manipulating the horizontal momentum equation |j!47 
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Figure 6: trajectories of the dynamical system fll8|) , plotted as dots At = 0.4 
apart, showing that although trajectories point away from the origin on y — 
0, nonetheless the nonlinear dynamics on the centre manifold, .M c , shows 
that the origin is stable. 
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to 

du du du dp ~ , , / 7r \ . , 

Tt = - n lT x - v Ty-T x +vVu +(1 -''>Uj »■ (19) 

and adjoining 7 = changes the spectrum. When 7 = 0, the introduced 
artificial forcing makes U\ a critical mode, along with rj, and hence there 
exists a centre manifold parameterised by u, measuring the amplitude of ui, 
the film thickness 77, and the artificial parameter 7. Setting 7 = 1 recovers 
the original pdes and so pursuing the analysis and subsequently setting 7 = 1 
leads to an approximate model for the original dynamics. The model is found 
I?7| to be 



— ~ 0.8238 {-gr) x + arj xxx ) - 1.504uu x - lAW—u - 0.1516— 77* (21) 
at rj z rj 

as in depth averaged equations but quantitatively different. The adapta- 
tion (|19D of the horizontal momentum equation is not unique. Exactly the 
same eventual model ([21]) is obtained ||146|| by appropriate manipulation of 



the tangential stress boundary condition at the free-surface. 

Similar ideas are being employed to analyse the dynamics of a turbulent 
river or flood. Initial work by Mei & I is reported in ||107|| where we took the k- 



e model of turbulent flow as the toe, and perturbed some critical coefficients 
so that a centre manifold inspired model could be constructed based upon 
the water depth rj and the depth averages of the horizontal velocity u, the 
turbulent energy k, and the turbulent dissipation e. Further analysis on 
this interesting model is in progress; it promises a sophisticated and reliable 
model of flood, river and estuarine dynamics. 

However, we need more powerful theory on infinite dimensional centre 
manifolds to provide rigorous support for these sorts of interesting slowly- 
varying, long-wave models. I tell my graduate students that as far as rigorous 
theory is concerned: for simple bifurcations we are on solid ground, for shear 
dispersion we may well be on thin ice, but in the application to thin film 
flows we are walking on water! 

3.4 Bands of critical modes — convection 

In a fluid layer heated from below, diffusion may damp all motion. If the 
heating is large enough then warm light fluid rises and cool heavy fluid falls. 
If the top and bottom boundaries are insulating, the case of fixed heat flux, 
as elaborated by Proctor et al [|33], 0, |132| , |56| , |136|| , the convection occurs 
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on a large horizontal length-scale, everywhere small wavenumber, and so it 
may be modelled by the approach of the previous subsection. 

But in the usual case of fixed temperature top and bottom boundary 
conditions, the fluid flow occurs on a horizontal length-scale of the same 
size as the height of the fluid layer. Near the critical temperature difference 
(measured by the Rayleigh number R), and using the trick of §§|2~3| again, 
a centre manifold may be found consisting primarily of a superposition of 
"rolls", say 

u ~ A£e ikx cos(£z) + c.c. , and v « Aike ikx sin(fe) + c.c. , (22) 

for some horizontal wavenumber k and some vertical wavenumber £, where 
A is the complex amplitude of the rolls and "c.c." denotes the complex 
conjugate of the appearing terms. The centre manifold analysis B |116| , e.g.] 
produces a Landau equation for the amplitude such as 

^ = (R-R c ) A- a\A\ 2 A + (A 4 + e 2 ) . (23) 

However, there are serious problems with such an application in the usual 
interesting case of convection with large horizontal extent. These problems 
are endemic to a wide range of pattern evolution problems as discussed in the 
review by Newell et al |126|1 . The critical spectrum typically looks like that 



plotted in Figure [7]. Almost all modes decay rapidly and so we should be able 
to form a low-dimensional model. However, there are a continuum of modes 
with wavenumbers k close to the critical (here k c = I/a/2), and for R > R c 
a finite band of these modes become weakly unstable. As in the previous 
subsections, there should be some way to use the centre manifold techniques 
and concepts to justify creating a low-dimensional model such as (|23"D. 

One avenue of rigorous application of centre manifold theory is mentioned 
in the start of this section. If we choose to seek just steady convective pat- 
terns, then we may treat the spatial variable "time-like" variable and 



construct |91], |115|| odes that model the spatial "oscillations" of the roll type 
structure in convection. Unfortunately, although useful for some purposes 
this approach seems rather limited: it does not address the dynamics, just 
the equilibria; and there seems no straightforward generalisation to the anal- 
ysis of the 2D planform adopted by a 3D fluid. 

At this stage, one useful approach to model the dynamics is to involve a 
mixture of centre manifold techniques and ideas from the method of multiple 
scales. There is no real rigor as yet in general. Use two space scales: the 
short space scale x to resolve the small-scale structure of the rolls; and a large 
space scale, X say, to resolve the large scale modulation of the rolls implied 
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Figure 7: eigenvalues of all modes in convection exactly at critical Rayleigh 
number versus the continuum of horizontal wavenumbers, k, possible in a 
layer of large extent. The different branches denote different modes in the 
vertical. This particular graph is for stress free boundaries and a Prandtl 
number of 1. 
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by the band of unstable wavenumbers. Then horizontal derivatives, d x in 
the Navier-Stokes equations, the toe, become d x + dx- We then treat dx 
as "small" just as in the previous subsections. The centre manifold algebra 
then proceeds straightforwardly to deduce a Ginzburg- Landau model 

dA d 2 A 

-^*(R-R c )A-a\AfA + f3— + ..., (24) 

for the amplitude of the rolls. Such Ginzburg-Landau models feature promi- 
nently in investigations of pattern evolution, see the review by Cross & Ho- 
henberg [|53], §III.C.2.d] . Recently Eckhaus |59| has proved that the Ginzburg- 



Landau equation is indeed relevant to one-dimensional pattern evolution. 
This centre manifold approach is superior to that of multiple scales alone, 
not only because of the better geometric viewpoint of centre manifold theory, 
but also because higher-order corrections may be computed without intro- 
ducing even further space and time scales |7C], Eqn.(2.3),e.g.] — just the one 
extra space scale is sufficient. Again, however, more theory is needed to 
support the algebraic formalism in the application of this idea to general 
problems and their models. 

The derivation of models of the spatially ID evolution of patterns, such as 



the Ginzburg-Landau model (|24|) for 2D fluid convection, is reasonable. How- 
ever, the low-dimensional modelling of patterns in two spatial dimensions, as 
in 3D fluid convection, is considerably more subtle [|126|| . To investigate 2D 
pattern evolution, it is natural to look at the modes and their interactions in 
2D Fourier space with wavenumber k. The difficulty in 2D pattern evolution, 
and I use convection as a specific example, seems to stem from the fact that 
the critical modes do not come from a localised band of wavenumbers, but 
from all the way around an annulus that extends a finite size in wavenumber 
space, \k\ ~ k c . The nonlinear interactions among such an annulus of modes 
are vastly richer than those among the small lump of critical modes in a ID 
pattern evolution. No really satisfactory modelling procedure has yet been 
developed, at least not to my taste. 

A satisfactory model should only resolve the slow evolution of the near 
critical modes. Failing that, one possibility is to carry some dynamical "dead 
wood" in the model by also resolving modes, maybe unphysical modes, which 



are exponentially decaying. This concept is developed in ||143|| where it was 



linked to the geometric idea of embedding a centre manifold and the evolu- 
tion thereon within the dynamics of a higher dimensional dynamical system, 
but nonetheless of lower dimension than the original toe. There I show 
that adiabatic iteration, namely the repeated application of adiabatic elimi- 
nation |175| , |173|| , is an effective algebraic procedure to do this embedding. 



An open question is: are there other, "better" embedding procedures? In 
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problems of the convection type, the adiabatic iteration embedding procedure 
leads to a generalised Swift- Hohenberg equation ||166|| , 



Q 2 

« (R-R c )a- (k 2 c + V 2 ) 2 a-a^^a 2 , (25) 

where is some particular radially symmetric convolution. The field a(x, t) 
has the same critical annulus of modes, |fe| ~ k c , in which the linear dynamics 
are that of the toe. Modes away from the critical annulus are irrelevant 
as they decay rapidly, they are the "dead wood." The correct interaction 
among the critical modes is obtained through the correct determination of 
the nonlocal nonlinearity in the convolution. Such a model is a remarkably 



accurate predictor of the pattern evolution ||142|| in a toy convection problem. 
Interestingly, people who invoke symmetry arguments to derive the Swift- 
Hohenberg equation generally fail to acknowledge the possibility of such a 
nonlocal nonlinearity even though it is indeed permitted [jTO], p30,e.g.]. 

Such spatio-temporal modelling of pattern evolution is perhaps a precur- 
sor to the modelling of turbulence with its variations across a wide range of 
spatial and temporal scales. One avenue I would love to find time to explore 
is to express turbulent fluid flow as a field of interacting wavelets and then 
embed the dynamics within some economical description. The idea is that 
the wavelets will resolve the wide range of space-time scales, and one of the 
techniques described herein will show how to model the interaction. 



4 Competing small effects should be inde- 
pendent 

It is characteristic of many interesting physical problems that there are sev- 
eral "small" parameters. In the Ginzburg-Landau equation ( p4|) for the pat- 
tern evolution of convection near onset there is R — R c , the amplitude A, 
the spatial derivative dx, and potentially the along-roll spatial derivative 
d y . In the flow of thin fluid films over a curved substrate, flTT|), there is the 
curvature of the substrate, the gradients of the free-surface, and potentially 
the Reynolds number, gravitational forcing, surface contamination, etc. The 
centre manifold approach enables a rational treatment of many and varied 
small effects, and then allows any consistent truncation when the model is 
applied. 
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4.1 Traditional scaling is restrictive 

In the construction of dynamical models it is traditional to scale a priori 
all such small effects together in terms of a single small parameter, say e. 
For example, to obtain the Ginzburg-Landau equation in convection: R — 
R c = e 2 , A = 0(e), d x = 0(e), and d y = O (y/e) H eqn.(4.6)]. For 
thin film flows, the substrate curvature k = O (e 2 ), d x = O (e) ||155|| , and, if 
not neglected entirely, gravity g = O (e 2 ) unless the substrate is nearly all 
horizontal when g — (e). This is done so that all the interesting dynamical 
effects occur at the one order in e, namely the leading order. But, to give just 
one example, in the spatially extended system of thin film flow there may be 
regions where surface tension through substrate curvature is the dominant 
forcing, and other regions, where the substrate curvature is constant, in which 
gravity is the dominant forcing, and further the substrate could be nearly 
horizontal in some places and nearly vertical in others. Demanding that all 
interesting effects be scaled to appear at leading order is too restrictive. It 
is a "straight-jacket" that traditional techniques force upon us at the outset 
of the modelling. 

The situation may be even worse. Sometimes the leading order model 



is structurally unstable, as in the Taylor model of dispersion (fUj l which to 
leading order in d x is just the advection equation d t C = —Ud x C. Higher 
order corrections, not appearing at leading order, are necessary to obtain a 
reasonable, structurally stable model. For simple problems, such as shear 
dispersion [|168| , Eqn.(17)] and propagating waves ||129| , p9] or convection 



rolls, the trick of transforming the TOE to a reference frame moving with 
an appropriate velocity, U in the case of shear dispersion and the group 
velocity in the case of waves, causes the low-order advection to disappear 
and the leading order in the model is then the higher-order terms needed 
for structural stability. However, in experiments one may have interacting 
waves or rolls travelling with different speeds or even in completely different 
directions. A moving reference frame cannot assist the analysis for these 
problems. The traditional scaling paradigm, of using one small parameter to 
scale all others and then requiring all effects to appear at leading- order, is 
fundamentally flawed. 



4.2 A consistent flexibility 

In contrast, centre manifold theory asserts, through Theorem ^ that one can 
approximate the shape of the centre manifold and the evolution thereon to 
any order in amplitude s. Competing small effects may appear at any order 
in the analysis, they need not just arise at leading order; after all the Taylor 
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series for exp(a;) is 1 + x + x 2 /2 + ■ • • to any convenient order. It is then 
consistent to include all terms up to a specific order in the model. 

However, with parameters one may be considerably more flexible. For ex- 
ample, Theorem |4] shows that the model describing the pitchfork bifurcation 
in 

x = ex — xy , and y = —y + x 2 , (26) 
may be written variously as 

x = ex - x 3 + O (a; 5 + e 5/2 ) 
= ex-(l-2e)x 3 + C(x 5 ,e 2 ) 
= ex - (l-2e)x 3 - 2x 5 + (x 7 + e 7/2 



These are all consistent truncations of the following multivariate asymptotic 
expansion 



00 00 ^ 



-x 3 (l-2e + 4e 2 -8e 3 + 16e 4 ) 
-x 5 (2 - 16e + 88e 2 - 416e 3 + 1824e 4 
+ ••• . 



As noticed by Coullet & Spiegel [44 , this feature is very important. The 



centre manifold approach allows you to compute as many orders as you like, 
different orders in the amplitudes and the parameters (even different for 
the different parameters), and then when you come to use the model, you 
may choose any consistent truncation that is appropriate for the particular 
realisation you wish to investigate. 

Such freedom is immensely valuable when there is any more than a couple 
of physical parameters in the problem. 

5 The slow manifold is central 

In a purely elastic body, elastic waves "ring" perpetually within the body. If 
these high frequency vibrations are ignored, then what is left is the relatively 
slow dynamics of rigid body motion. The flight of a ball is an example already 
mentioned in §|TJ. 

Muncaster and Cohen ||118| , |4T[| suggested the construction of the low- 



dimensional manifold of slow, rigid-body dynamics by neglecting the fast 
modes. The extremely simple example of the motion of a one-dimensional 
elastic body is discussed in |145| , §2]. In contrast to the rapid collapse to 
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the centre manifold, the slow dynamics on the slow manifold form a low- 
dimensional model because they act as a "centre" for the fast oscillations of 
neighbouring trajectories, see Figure |8| for example. This principle of neglect- 
ing fast oscillations is completely equivalent to the guiding centre principle 
of Van Kampen ||175| , which is frequently invoked in plasma physics, see 



21, H2l E9| for some recent work. 



5.1 The linear basis — beam models 

The construction of such a slow manifold uses exactly the same techniques 
as described earlier. It is based on the Approximation Theorem |3|, or |], with 
the distinction that the slow manifold (.Mo) has the slow subspace (£ ) as its 
tangent space at the origin, instead of the centre subspace. The slow subspace 
being that space spanned by the eigenvectors and generalised eigenvectors 
of the precisely zero eigenvalues. For example, consider the dynamics of a 
long thin elastic beam. All the vibrations are fast except for the large-scale 
flexure, torsion and displacement of the beam. Applying the same ansatz of 
slowly- varying dependence along the beam [|145|| , similar to that discussed in 



§ §3.2j for dispersion, we may identify an 8-dimensional slow subspace in the 
cross-sectional elastic dynamics: displacements and velocities sideways (two), 
longitudinally and rotationally. Coupled with the assumed slow variations 
along the beam, the analysis holistically constructs dynamical models for the 
beam bending, torsion and stretching. In linear elasticity of a circular beam 
all these models decouple [ |145|| . However, for a nonlinear or non-circular 
beam, the analysis naturally couples the dynamics. Computing the slow 
manifold to various asymptotic orders results in models equivalent to the 
range of models of classic beam theory. The concept of a slow manifold is 
also useful in forming low-dimensional models of dynamics. 

You may have noted that all the specific examples of centre manifolds 
discussed in earlier sections have also been slow manifolds as they are based 
upon zero-eigenvalue modes. However, in this section I specifically focus on 
situations where the slow dynamics occurs among fast oscillations. That is, 
we take the spectrum of the linear dynamics to consist entirely of some zero 
eigenvalues and some purely imaginary eigenvalues. 

5.2 Nonlinear problems — geostrophy 

The above applications have so far been to notionally linear problems. The 
slow manifolds of nonlinear dynamics are also of interest. This is shown, 
for example, in the importance of the concept of geostrophy in atmospheric 
dynamics, see recent work in [KB], E2). Lorenz ||102j| introduced the five mode 
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Figure 8: a comparison of the trajectories on (solid) and off (dashed) the slow 



manifold M.q for the Lorenz system (27). Observe that the fast oscillations 



off the slow manifold reasonably track the evolution on M.$. 
dynamical system 

it = —vw + bvz 
v = uw — buz 

w = —uv (27) 

x = — z 

z = x + buv , 

to illuminate the nonlinear slow manifold of quasi-geostrophy. Observe that 
x and z oscillate quickly, while u, v and w evolve slowly, at least near the 
origin. A couple of trajectories of this system are plotted in Figure [8[ The 
slow manifold of this 5-dimensional toe is 3-dimensional based upon the 
three eigenvalues associated with u, v and w in the linear dynamics. Theory 
by Sijbrand ||160| , §6-7] is relevant to the existence of a slow manifold for (f27D, 
namely 

x = -buv + O (s 4 ) , z = b(u 2 - v 2 )w + O (s 5 ) , 



where s = \(u,v,w)\, to some level of smoothness. Lorenz later argued ||101 



that truly slow dynamics do not exist in ( p7|) because if it did then there must 



be an infinite number of singularities in the slow manifold. However, Cox & 
I |f^B| have shown that the singularities are exponentially weak and so are 
negligible for small enough amplitude flow. Recently, Bokhove & Shepherd 
P7[ , Boyd P0| , Camassa ]23j, and Lorenz | |103| | have further elucidated the 
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structure and dynamics associated with the slow manifold of (pTD, and a 
connection with inertial manifolds has been made by Debussche & Temam 
H, |5|. 

The concept of a slow manifold is generally applicable to Hamiltonian 
dynamical systems because of their typical spectrum. Examples are found 
in atmospheric dynamics ||150|| , water waves [48], 127|| , and plasma physics 

Pi1,rapq,|r79fl. 

All the above issues are intriguing and deserve further study, but there is 
a further twist in such modelling: there is no relevance theorem for the low- 
dimensional dynamics on the slow manifold. There is no rigorous assurance 
that they do indeed model the toe. Instead, Cox & I [46|, |47| used normal 
forms, see § §6.2| , to show that the dynamics on and off the slow manifold 
generally differ by an amount of O (r 2 ), where r measures the amplitude 
of the fast oscillations, it measures the distance off A4q. That is, there is 
some unavoidable slip between the model and the toe. Thus, in general, 
one can only expect a slow manifold model to be accurately predictive for a 
time o (1/r 2 ). 

Lastly, I mention that Sijbrand ||160|| , building upon work by Lyapunov, 
actually proves theorems about sub-centre manifolds. That is, manifolds 
based upon the eigenspace of a pair of pure imaginary modes; eigenvalues 
that are precisely are a special case. His theorems are directly relevant to 
the existence and construction of nonlinear normal modes of oscillation as 
investigated by Shaw et al | |158| , |157| , |159| , |122| . It may be that such theorems 
also provide the basis for a justification of modulation equations describing 
the slow space-time evolution of the amplitude and phase of nonlinear dis- 
persive waves. A simple example being the nonlinear Schrodinger equation 
usually derived using the method of multiple scales. However, a sub-centre 
manifold approach to the modulation and interaction of nonlinear waves has 
been elucidated in |l I I . 



6 Initial conditions are long-lasting 

Many low-dimensional models are used simply to explore the range of dy- 
namical possibilities. For example, in control applications one wants to be 
assured that the specified control scheme will stabilise the system. How- 
ever, many models are used to make definite predictions of later times given 
that the system starts from a given initial state — the forecast problem. So, 
suppose you know the initial state of the system for the TOE: what is the 
corresponding initial condition for the model? 

For example, if a pollutant is released into a river from a given site, we 
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would wish to know what will be the dispersion of this specific cloud of 
pollutant. If the pollutant is released in the middle of a channel it will be 
initially carried downstream quicker than if it is released at the side; in the 
long-term the pollutant clouds will have different mean locations. The initial 
condition used for the model should be able to reflect such differences in the 
release. Appropriate initial conditions are also crucial in the derivation of 
correct boundary conditions, see §f| 

Remarkably, this issue of providing the correct initial conditions for a low- 
dimensional dynamical model has received very little attention in the past. 
In many cases this is because attention has focussed on the typical dynamics 
inherent in a model. However, even when interested in making definitive 
forecasts, generally people have simply assumed that the provision either is 
according to the linear dynamics or is simply by the evaluation of the "ampli- 
tudes" in the model. That these assumptions are not always sound has been 



occasionally recognised in the phenomenon of "initial slip" W3, pQ, 72, 174 



As developed in ||139| , |7]] a useful procedure for determining correct initial 
conditions for a low-dimensional model is based on the geometric picture of 
a centre manifold in the state space. 

6.1 Projecting initial conditions onto the model 

The Relevance Theorem ^| assures us that there is indeed a particular solution 
of the low-dimensional model on Ai c which is approached exponentially by 
every trajectory of the toe (provided the trajectory starts close enough to 
Ai c ). This is illustrated in Figure P where trajectories of the dynamical 
system ([]]) from three different initial conditions all have the same long-term 
evolution to a difference which decays exponentially quickly. The modelling 
task is to find the projection P from any given initial state off A4 C , say uq, 
onto a state on A4 C , say v(s ), so that the long-term evolution, from s in 
the model, will be the same to an exponentially small error. Some algebra 
finds this projection. 

To be precise, the projection will be along the curved isochronic mani- 
folds, or isochrons ||181| , |78|| , as shown in [|139|| . However, as in the example 



plotted in Figure over a large part of the state space a linear approximation 
to the projection may be quite adequate; "linear" in distance away from _M C) 
but varying with s along hA c . Such a linear projection is most easily defined 
by linearly independent normal vectors to the isochronic manifold at Ai c , 
such as z = (1, —x/(l + 2x 2 )) shown in Figure |^. That is, we approximate 
by projecting along the tangent planes of the isochronic manifolds. Then the 
initial condition, s , for the model is found from the requirement that the 
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Figure 9: trajectories (solid) of ([I]) from three different initial conditions, all 
with the same long-term dynamics on the centre manifold A4 C (dashed) to 
an exponentially small error. The circles are plotted at At = 1 apart. The 
modelling issue is to find the projection P (dotted) from any given initial 
condition off Ai c onto one for the model on hA c . P is described by its 
normal vector z at A4 C . 
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displacement is orthogonal to the normal vectors Zf 

( Zj ,u -v(s )) = 0, (28) 

where the angle brackets denote a suitable inner product. For an m-di- 
mensional centre manifold within an n-dimensional dynamical system, the 
isochronic manifolds are of dimension n — m (the state space "collapses" 
by this many dimensions), and so we need m linearly independent normal 
vectors Zj to define this projection. 

In the immediate vicinity of the fixed point at the origin of the general dy- 
namical system (^[), linear arguments suggest the vectors Zj are eigenvectors, 
or generalised eigenvectors, of the adjoint eigen-problem 

tfz, = . 

These give the correct projection onto S c under the linear dynamics. Under 
the nonlinear dynamics inherent upon the centre manifold Ai c , dynamical 
arguments given in ||139|| show that to find the projection vectors Zj(s) as a 
function of position on A4 C , we solve 

Vzj - (Dzj, e k ) z k = and (Zj, e k ) = S jk , (29) 

k 

where V encapsulates the dynamics of trajectories near M. c as 

Vz = "57 + >? z > 
at 

in which the chain rule determines that 
and is the adjoint of the Jacobian 

df 



J = C+ .. 

ou 



M c 



As shown in ||109| , |110| , |17^| , upon applying the formulae (|28|) and (p9|) to 



the dispersion of a contaminant in a channel or pipe, we accurately predict the 
different displacements of the mean concentration that occur from different 
release positions across the channel or pipe. The similar phenomena of a 
long-term variance deficit in the spread of the contaminant is also predicted. 
With the geometric picture of centre manifolds we have created a mechanism 
to provide correct initial conditions for low- dimensional dynamical models. 
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6.2 Normal forms also show the way 

Commonly, as intimated at the start of §0, the normal form transforma- 
tion is applied to the dynamics after reduction from the toe to the centre 
manifold. The normal form then assisting in the classification of the dynam- 
ics. However, the normal form of the complete dynamics of the TOE clearly 
shows both the low-dimensional model (Elphick et al p2| |) and the correct 
projection of initial conditions (Cox & I 



For simplicity of discussion suppose that the dynamics of the toe are 
given in the separated form Then we may seek a nonlinear, but near 

identity, coordinate transformation 

x = X + 3(X,Y) , and y = Y + *(X ,Y) , 

such as that shown in Figure 10, so that the toe is transformed to 



x = Ax + f(x,y) X = AX + F(X) 

y = By + g{x,y) > Y = BY + G(X,Y)Y { ] 

This is always possible given the pattern of eigenvalues for the existence of 
a centre manifold. For the example system ([I]), the nonlinear coordinate 
transformation 

x = X + XY + -XY 2 + ■■■ 
2 

y = Y + X 2 + 2Y 2 + AY 3 + ■ ■ ■ , 

shown in Figure |TD|, separates the dynamics to 

X = -X 3 , and Y — —Y — 2X 2 Y + ■■■ . 

In the form fl3T|), observe that Y = is clearly the invariant and expo- 
nentially attractive centre manifold. But also, both on and off A4 C , the X 
evolution is completely independent of the decaying modes Y. Hence all so- 
lutions of the toe from initial conditions with the same X have precisely the 
same X evolution for all time, and thus they all tend to the same solution 
on the centre manifold. Thus the normal form shows that the projection of 
initial conditions onto the centre manifold is along constant X. Constant X 
are the isochronic manifolds. 

The normal form transformation works its magic by decoupling the cen- 
tre modes, X, from the quickly decaying modes Y. For slow manifold mod- 
els which neglect fast oscillations, that is guiding centre models, a normal 
form coordinate transform will similarly exhibit the slow manifold as Y = 
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Figure 10: the normal form transformation of (|l|): the dashed lines are the 
constant X isochrons; the dotted lines are constant Y\ with AX = AY = 0.1. 
The centre manifold is the dotted curve (Y = 0) emanating from the origin. 
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46] , 4"7j| . The coordinate transform will also remove terms linear in Y from 
X. However, in general, terms quadratic in Y cannot be eliminated from 
X — there is generally a resonant forcing of the slow modes, X, by the fast 
oscillations or waves, Y, which is quadratic in the oscillation amplitude. 
Thus, as mentioned in §[5], the evolution of the toe is generally slightly but 
unavoidably different to that of the slow model. An example would be the 
phenomenon of Stokes drift generated by any "fast" water waves superim- 
posed upon the dynamics of large-scale currents. There are limitations to 
low-dimensional models based upon the concept of a slow manifold (or a 
sub-centre manifold). 

Although the normal form of the toe is a very useful conceptual tool, 
it does not provide a practical method for constructing a low-dimensional 
model. The reason is that it involves considerable wasted algebra in the 
transformation of the ultimately neglected stable and/or fast modes. If there 
are many stable mode, as usual in interesting physical systems, then the 
normal form transformation may be practically impossible, whereas methods 
based upon the Approximation Theorem H will be manageable. 



7 Enforcing some surprises 

So far we have implicitly restricted attention to unforced dynamical systems. 
The presence of small forcing in the toe may be transformed into a forcing of 
the model. Discussed in the following subsections are the cases of determinis- 
tic forcing and of stochastic forcing or noise. The centre manifold formalism, 
coupled with the projection of initial conditions, permits an accurate mod- 
elling of the effects of the forcing. Remarkably, small forcing that otherwise 
would be neglected can have a large effect on the model's dynamics. 

7.1 Deterministic forcing 

Consider the dynamical system ([]]) with the y mode forced by a steady effect 
e: 

x = —xy and y = —y + x 2 — 2y 2 — e . (31) 

As for the initial condition problem, a simple projection of the forcing onto 
S c would indicate that this particular forcing would have little influence on 
the low-dimensional model. However, this is not so. The correct model is 
that on the perturbed centre manifold y ~ — e + (1 4- 2e)x 2 the evolution is 

x « ex - (1 + 2e)x 3 , (32) 
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Figure 11: evolution of a dynamical system with discrete impulsive forcing 
and the corresponding evolution of its low- dimensional model on A4 C . The 
trajectories (solid) are "kicked" by each impulse (F, dashed). To maintain 
the correspondence between the exact solution and its model, the impulse 
has to be projected (P, dotted) along the isochronic manifolds onto M. c to 
become an impulsive forcing for the model. 



which exhibits a pitchfork bifurcation with two stable fixed points at x ~ y/e. 
This is a large response in the model to a small forcing. Such a significant 
change in a model may be typical because the slow evolution on the centre 
manifold is sensitive to small influences. 

Forcing may be incorporated into a model by two approaches. Firstly, if 
the forcing is constant, the toe is autonomous, then a simple trick will suffice 
to put the dynamical system within the rigorous scope of centre manifold 
theory For the above example, simply substitute e = 6 2 , say, and adjoin 
the trivial dynamical equation 5 = 0. Then the forcing becomes a nonlinear 
term in the dynamics, the spectrum shows a centre manifold parameterised 
by the modes x and 5, and the construction of the centre manifold and the 
evolution thereon leads to the forced model (p2|). 

Secondly, for time- dependent forcing an argument developed in [135] will 
suffice. Suppose a general dynamical system @ has a small applied forcing 
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F(t), namely 

u = Cu + f(u) + F(t). (33) 

Imagine approximating the forcing by a sum of impulses, F = Fj5(t — tj), 
at discrete times tj. Then within each force free interval, the centre manifold 
is exponentially attractive, as shown in Figure 0, and the unforced model 
applies. Each impulse "kicks" the dynamical system off A4 C , see Figure [11]. 
As in the initial condition problem, the evolution following such a "kick" 
exponentially quickly approaches the evolution of some particular solution 
on M. c . This solution is also obtained by some particular impulse, found 
by projecting the impulse Fj, applied to the low-dimensional model. The 
sequence of such projected impulses then approximates a continuous forcing 
of the model, say G(s, t) in 

a = Gs + g(s) + G(s,t). (34) 

Letting 

R • f I 9V \ 

Bn = inverse of ( Zs, — — > , 

the appropriate projection of the forcing of the toe into a forcing of the 
model is 

G i = Y t B ii {x i ,F) . (35) 

3 

This argument is accurate to errors O (F 2 ), it gives the linear projection of 
the forcing. Algebraic formula for higher order corrections, in F, have not 
yet been found. 

For the example (|31"]), G = ex and hence the forced model is 

x ~ ex — x 3 . (36) 

This model is apparently different to the earlier (1321). The reason for the 



difference is that implicitly we have used a different parameterisation of the 
forced centre manifold. Cox & I [55] showed that there is extra freedom in 



parameterising a forcing because such forcing typically moves the evolution 
off the centre manifold into new regions of state space. However, we also 
showed that, in general, the forcing in the model then undesirably depends 
upon an integral over the previous history of the time-dependent forcing — a 



memory effect as also noted in §§ |3.2| for shear dispersion [ |162j| . The only 
way to eliminate memory integrals in the dynamics of the model is to use 
the isochronic manifolds as a basis for the parameterisation off A4 C , as done 
implicitly in the argument above. The geometric picture provided by centre 
manifold theory enables us to correctly incorporate forcing. 
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In application to beam theory ||145|| , for example, the correct treatment 



of forcing allows us to predict the "toothpaste effect" , that is, we predict the 
longitudinal extrusion of an elastic rod which results from a purely lateral 
compression! 

7.2 Stochastic dynamical systems 



In practice we may need to model dynamics in a noisy environment [|172| , 
e.g.]. Just one example of interest is the dispersion of a contaminant in a 
turbulent river — the turbulence can only reasonably be modelled by invoking 
stochastic factors. How do we construct low-dimensional models of stochastic 
differential equations (sdes) using centre manifold ideas and techniques? 

Currently there seem to be a number of largely disparate threads in the 
modelling of SDEs. Boxler, Arnold et al |19|, [7|, prove theoretical results 
about low- dimensional centre manifolds of SDEs. However, the analysis is 
sophisticated and the results, as seen in examples, seem difficult to apply. 



Analysis of Fokker-Plank equations lead to "weak models" plj, |63|, ^9] 



"weak" in the sense that detailed information about the noise is irretriev- 



ably lost to the model. Systematic adiabatic elimination [|152| , |153| , |154|| and 



normal form transformations [CM |121|| have also been suggested, but 



typically suffer from introducing many complicated noise processes into the 
dynamical model. 

Inspired by the work on forcing described in the previous section, Chao & I 
|31~1 , §3] realised that much of the complication may be removed from the noise 
in a low-dimensional model. On the long time-scale of the evolution on the 
centre manifold, the noise processes are essentially white and a little algebra, 
based upon the freedom to parameterise the forced centre manifold, explicitly 
shows this. However, such simplification only works for effects linear in the 
stochastic noise. Effects quadratic in the noise are more complicated. For 
example, stochastic resonance leads to irreducible noise processes appearing 
in the model, such as w(t) from the (Stratonovich) sde 

dw = ZdW, and dZ = -(3Z dt + dW, (37) 

for a given noise W(t) in the toe. Observe that Z is a coloured noise gener- 
ated directly by W, then Z and W together induce the new noise w. Neither 
normal form nor centre manifold algebra can simplify the representation of 
the induced stochastic process w{t). However, a centre manifold analysis of 
the corresponding Fokker-Plank equation |3IL §4] suggests that we replace 
w(t) by its long-term drift and fluctuation, 

dw « \dt + ^—fjjdW , (38) 
2 2y p 
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where W'(t) denotes a new and independent noise. In essence, the nonlinear 
machinations in ( |3~7D extracts information about W that cannot be obtained 
by sampling W over large times, information which is thus independent and 
can only be represented on the long time-scales of the model by a new noise 
process. 

Much further research is needed to apply these ideas and provide theo- 
retical support. 



8 At boundaries 

Models expressed as partial differential equations, such as those for disper- 
sion in a river and for beam theory, require boundary conditions at the limits 
of the domain, the inlet and outlet ||163|| or the ends of the beam respectively. 



Such models as these are typically derived through a slowly-varying approx- 
imation under the assumption that the domain of interest is arbitrarily large 
as discussed in §[| However, typical physical situations of interest possess 
finite domains. The issue is: what are the correct boundary conditions to 
be used at the edge of the domain for such model equations? The provision 
of correct boundary conditions are sometimes crucial — in large aspect-ratio 
convection the boundary drives the entire nature of the long-term dynamics, 
126j p444] or f7| §3]. 



sec 



Relatively little work has been done on determining correct boundary 
conditions. When interested in generic dynamical behaviour one typically 
just uses periodic boundary conditions, |95], |87], [3| for example. Alterna- 
tively, one may only allow boundaries in the original problem which will fit 
neatly into the scheme of the asymptotic approximation, [|33, 156 , 145 1 for 



example. These two choices are forced by the inability of primitive asymp- 
totic schemes, such as the method of multiple scales, to embrace the presence 
of typical physical boundaries. Alternatively, in realistic physical problems 
heuristic arguments may supply approximate boundary conditions for the 
model, but are they mathematically justifiable? Examples are the bound- 
ary conditions used with beam theory for the idealisations of free, fixed or 
pinned ends. Cross and others |y], [5^, |106| have used matched asymptotics 



to derive boundary conditions for two-dimensional convective rolls; however, 
their analysis is linear near the boundary, and yet needs to be nonlinear in 
the interior. More attention needs to be given to this important aspect of 
modelling. 

Some special invariant manifolds (§§ [2.1| ) in conjunction with the cor- 
rect projection of initial conditions (§|6]) provide a route to determine cor- 
rect boundary conditions |142| |. Boundary conditions are provided by two 
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separate and complementary arguments; both relying on the same trick of 
investigating the spatial evolution away from the boundary into the interior 
(also mentioned in given also a slow time evolution. In essence, we probe 
the dynamics of the boundary layers at either end of the domain and how 
they merge into the slowly-varying interior solution. The dominant terms in 
the boundary conditions typically agree with those obtained through simple 
physical arguments. However, refined models of higher order require subtle 
corrections to the previously- deduced boundary conditions, and also require 
the provision of additional boundary conditions to eliminate unphysical pre- 
dictions and to form a complete model. 

8.1 The physical boundary layer 

In the TOE with slow time evolution, the spatial evolution away from a bound- 
ary consists of: exponentially decaying "stable" modes; exponentially grow- 
ing modes which are not seen as the far distant boundary removes them; 
and nearly neutral modes which correspond to those of the interior model. 
Thus near any boundary, because of the dynamics inherent in the differential 
equations of the toe, the system must lie in the centre-stable manifold (to an 
exponentially small error in the length L of the domain). This centre-stable 
manifold may be constructed. 

As an illustration of the ideas, consider the shear dispersion problem 
shown in Figure [|. If the time dependence is negligible, solutions c'(y)e Xx 
exist where 

+ (SX 2 - u(y)X)c' ^ . (39) 

There exists solutions: 

• A = 0, d constant, corresponding to the critical mode of the slowly- 
varying centre manifold model; 

• modes with negative eigenvalues, approximately A = —3.414, A = 
—12.25, etc, describing how the cross-stream diffusion, d 2 c'/dy 2 , expo- 
nentially smooths out details of the inlet concentration as it is advected 
downstream by the profile u(y); 

• and modes with large positive eigenvalues, A oc 1/5, allowing upstream 
diffusion to accommodate the interior concentration to any particular 
outlet condition. 

The centre-stable manifold near the inlet is approximately the space spanned 
by the critical mode with A = together with the modes of negative A. 
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Conversely, at the outlet and viewing the dynamics towards negative x, the 
centre-stable manifold is approximately the span of the critical mode together 
with the modes of positive A. 

A boundary condition must be given as part of the toe. Such a boundary 
condition intersects the constructed centre-stable manifold to form the set of 
possible states that may hold at the boundary These states form a set of 
possible "initial conditions" for the spatial evolution away from the boundary. 
The states in the intersection are then projected onto the centre manifold (of 
the spatial evolution) using the initial condition arguments described in §||to 
give a set of allowable states for the centre manifold model at the boundary. 
These determine some boundary conditions for the low-dimensional model. 

For the example of shear dispersion in a pipe or channel, these arguments 
generally provide one inlet condition for the Taylor model (0), but provide 
no constraint at the outlet [ 142 , §2, §3.1] because the centre-stable manifold 



at the outlet is of one higher dimension, thus has a larger intersection with 
the exit boundary conditions, and hence does not restrict the states of the 
model at the outlet. 

8.2 The boundary layer of the model 

As noted for Taylor's model of dispersion, some low-dimensional models 
need more boundary conditions than the previous argument supplies. Such 
boundary conditions come from considering the dynamics of the model in 
the boundary layers at either end of the domain. 

Given slow variations in time, the spatial evolution of the model into the 
interior consists of: critical modes which correspond to those of the low- 
dimensional model seen in the interior; unphysical exponentially decaying 
modes which do not penetrate far into the interior; and unphysical expo- 
nentially growing modes which the far boundary must remove. We require 
that there be no unphysical stable modes near a boundary | |142| , §3.2] as 



otherwise there will be unsightly and unphysical transients in the model's 
solutions. Thus the system must lie in the centre-unstable manifold of the 
model, which we may construct. The fact that any solution actually lies in 
the centre manifold is assured by the far boundary because a boundary's un- 
stable modes correspond to the far boundary's removed stable modes. This 



requirement provides sufficient additional boundary conditions [|142| , §3.3]. 

For example, in the Taylor model (|ll|) and for negligible time variations, 
solutions e Xx exist with A ~ and A ~ U/D. At the outlet, the stable mode, 
approximately e Ux ^ D , is removed by enforcing a condition that the system 
is on the centre-unstable manifold (here just the centre manifold as there 
is no unstable mode). This provides a boundary condition at the exit to 
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complement the entry boundary condition from the previous argument. The 
argument here does not provide an entry boundary condition as there is no 
stable mode in the Taylor model at the inlet. 

These two arguments together very neatly provide boundary conditions 
for models with one slowly-varying spatial dimension and slow variations in 
time. Outstanding is a resolution of the apparent differences between this 



approach and the more specialised approach employed for beams in [|145 
and the provision of boundary conditions for oscillatory critical modes. Also 
outstanding, but of considerable interest, is the issue of what to do for models 
involving two spatial dimensions, such as models of thin, elastic plates and 
of planform evolution in convection. 

9 Computer algebra handles the details 

Computing details of the shape of a centre manifold and the evolution thereon 
may involve copious algebra. A leading order approximation is often tractable 
by hand, but when this approximation is not structurally stable then the req- 
uisite higher-order corrections are typically tedious to determine. Extremely 
high-order calculations, for example to determine the spatial resolution of 
dispersion §§ |3.2| or beam theory | ]145| , are grossly tedious. Computer al- 



gebra may reduce the human labour involved. The challenge is to develop 
algorithms which are simple to reliably implement. 

9.1 Explicit series expansions 

Various computer algebra packages have been used to compute centre mani- 
folds, such as Maple pE| , Reduce |H| and macsyma ||135|| , and also normal 
forms ||135| , |68| . 



In problems with centre manifolds of small dimension, 1, 2 or 3 say, the 
usual approach is simply to seek an explicit multinomial form. One then 
substitutes into the governing equations, gathers like terms, and solves for 



the unknown coefficients. See for example Rand & Armbruster's [134, pp27 



34] Macsyma code or Freire et aVs |)9[ Reduce code for constructing the 



centre manifold of a finite-dimensional dynamical system. But this approach 
fails for centre manifolds of higher dimension, especially for the "infinite" 
dimensional centre manifolds associated with spatio-temporal models. For 
example, in lubrication models of thin film flow (§ |3.3| ) there are 5 basic terms 
of the leading, fourth-order, namely r)% t? x t} xx , rf xx , r] x r] xxx and r] xxxx , each of 
these possibly combined with the multiplication by an arbitrary power of r\. 
It very soon becomes impractical to code a complete sum of general terms. 
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Another approach is to select one or two "ordering parameters" that 
measure the size of all nonlinearities and all other small effects. Then express 
the model explicitly in terms of asymptotic sums in these ordering parameters 



with functional coefficients which are to be determined ||147| , |108| , e.g.]; the 
form of the unknown coefficients are found in the working, a general form 
need not be explicitly written down beforehand. To reduce the dynamics onto 
the centre manifold, one then has to substitute the asymptotic sums into the 
governing equations, reorder the summations, rearrange to extract dominant 
terms, and evaluate the expressions. While perfectly acceptable when done 
correctly, it leads to formidable working which obscures the construction of 
a model. Further, such asymptotic expansions, in common with the method 
of multiple scales, reinforces the notion that careful balancing of the "order" 
of small effects are necessary in the construction of a model rather than in 
its use in some situation (§f|). 

9.2 Implicit approximation 

Recently I proposed ||148| an iterative method, based upon the residuals of 
the governing differential equations of the toe, as shown schematically in 



Figure [12]. The evaluation of the residuals is a routine algebraic task which 
may be easily done using computer algebra by simply coding the governing 
differential equations; it replaces the whole messy detail of the manipulation 
of asymptotic expansions (e.g. pi], §5.4]). In the same spirit as comments 
made by Barton & Fitch [|ll|, §2.3] in 1972, the aim of this proposed approach 
is to minimise human time by using a novel algorithm which is simply and 
reliably implemented in computer algebra, albeit with inefficiencies in the 
use of computer resources. 

Given a generic dynamical system (R) we seek a centre manifold u — v(s) 



on which s = Qs + g(s). As in §§§ |2.2.3| , if 4> an d ^ approximate v and s 



respectively, then I argue [ |148|| that corrections, </>' and ?/>', may be found by 



solving the homological equation 

C<t>' -^fgs-Vi>' = R{4>,i>), (40) 

OS 

where V = d<fi/ds\Q, and recall that R is the residual of the toe. Gener- 
ally this produces linear convergence to M. c and the low- dimensional evolu- 
tion, linear in the sense that each iteration corrects the next order or two 
of the expressions. The algorithm for the computer algebra derivation of 
low-dimensional models is relatively: simple to implement, because the com- 
putation of the residual is via a direct coding of the governing differential 
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0,-0 



Figure 12: schematic diagram of an iteration to determine the centre mani- 
fold. It depicts the linear operator, £, at the fixed point at the origin guiding 
corrections to the description, v & G, based upon the residuals of the toe. 

equations; flexible because many changes to the toe can be simply accom- 
modated by updating the residual computation; and reliable, because it relies 
upon the actual residual going to zero — any error is picked up by a lack of 
convergence. 

This algorithm has already been used to develop models of thin film 
fluid dynamics upon curved substrates with gravitational and inertial effects 
|146| , |149|| . A currently outstanding issue is developing a companion iteration 
scheme to determine the correct projection of initial conditions (§|6|) and 
forcing (§0). 



10 Conclusion 

We have looked at geometric based arguments about how to form accurate 
and reliable low-dimensional models of dynamical systems. The aim is to 
take a so-called "Theory Of Everything" (toe), a complete but far too de- 
tailed description of the system, and produce a "coarse grained" model that 
captures all the dynamics, and little else, that are of interest in a partic- 
ular application. Although the geometric arguments are supported centre 
manifold theory, we have seen that many applications go beyond the current 
rigorous support. 

This approach to modelling has many advantages: 
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the signature of the model is straightforwardly derived from linearisa- 



tion (§§§2.2.1, §ph, but one can be inventive (§§[2.3|, §§|3.3|, §§3.4) 



• the model may be systematically refined (§§§ |2.2.3j , §§|2.3|, §§|3~i2j), per- 
haps using computer algebra to handle most of the details (§|9|); 

• one may be very flexible about the relative magnitude of "small" pa- 
rameters, resulting in a model which is later justifiably tuned to specific 
applications (§[§); 

• it provides correct initial conditions for forecasts (§§|), initial conditions 
that guarantee fidelity between the predictions of the model and the 
long-term evolution of the full dynamics; 

• may account for smooth or stochastic forcing (§0); 

• establishes an approach to determine correct boundary conditions for 
the models (§§). 

How to decide upon an accurate toe on which to base the analysis is 
another problem — a model is only guaranteed if it is based upon an accurate 
description of the dynamics. 
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